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ABSTRACT 

Mathematical  models  are  developed  to  describe  the  capability  of  human 
operators  observing  A,  B,  and  PPI  displays  of  noncoherent  radars  for  detect¬ 
ing  target  signals  in  receiver  noise.  The  models  are  derived  from  visibility 
data  of  World-War-II  experiments  using  curve-fitting  techniques  guided  by 
simple  physical  models.  The  trends  of  performance  are  compatible  with  the 
predictions  of  detection  theory,  and  calibration  constants  are  assigned  based 
upon  experimentally  determined  human  operator  characteristics.  Radar  variables 
which  are  incorporated  in  the  models  include  pulse  length,  receiver  bandwidth, 
antenna  beamwidth  and  scan  rate,  pulse  repetition  frequency,  and  display 
brightness,  geometry  and  phosphor  characteristics.  Data  are  presented  from 
experiments  on  detection  of  target  signals  in  sea  clutter  by  human  operators. 
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I .  INTRODUCTION 


The  detection  of  radar  signals  is  implemented  using  human  operators 
viewing  displays  which  are  either  deflection  or  intensity  modulated  by 
the  received  signal.  Tne  properties  of  these  displays  were  studied  ex¬ 
tensively  during  World  War  II  and  sporadically  since  that  time  in  investi¬ 
gations  to  describe  the  dependences  of  the  minimum  detectable  signal-to- 
noise  ratio  on  the  numerous  radar  variables  and  parameters.  Attempts  to 
build  mathematical  functions  to  represent  these  dependences  were  made  by 
Haeff  [1]  for  the  A-Scope  and  Payne-Scott  [2]  for  the  PPI  display,  but 
other  investigators  have  ignored  the  question  of  a  comprehensive  model. 

In  the  present  study,  the  models  of  riaeff  and  Payne-Scott  ar  1  the 
contributions  of  others  since  have  been  reviewed,  and  revised  functions 
have  been  derived  to  describe  the  performance  of  human  operators  viewing 
real  radar  displays  of  the  A  and  PPI  types  under  the  following  assumptions: 

(1)  Adequate  time  is  provided  for  the  operator  to  scan  the  area  in 
which  signals  are  presented. 

(2)  The  target  signal  is  non-fluctuating  in  a  background  of  receiver 
noise. 

(3)  The  operator  is  not  handicapped  by  long-term  fatigue  effects  or 
other  distractions. 

(4)  The  minimum  detectable  signal-to-noise  ratio  corresponds  to  a 
probability  of  detection  of  0.5  within  a  basic  time  interval  of 

a  single  scan  or  phosphor  decay-time  constant,  whichever  is  longer. 

In  the  following  chapters  the  A-Scope  and  PPI  display  are  treated  by 
identifying  the  pertinent  input  variables,  by  presenting  an  algorithm  ex¬ 
pressing  the  minimum  detectable  signal-to-noise  ratio  as  a  function  of  the 
input  variables,  and  by  discussing  the  physical  significance  of  the  various 
factors  of  the  function.  Validation  of  the  algorithms  is  offered  by  refer¬ 
encing  specific  experimental  work  to  which  the  function’s  parameters  are 
adjusted.  The  domains  over  which  the  algorithms  are  considered  valid  are 
identified  in  the  respective  chapters.  The  accuracy  of  the  equations  and 


parameters  is  such  that  the  'it  to  the  data  is  comparable  to  the  spread 
of  the  data  points  (about  +  1.5  dB)  except  at  a  few  combinations  of  para¬ 
meters  . 

The  output  of  the  display  models  is  a  minimum-detectable  signal-to- 
noise  ratio  for  a  probability  of  detection  of  a  pulsed  noncoherent  signal 
in  noise  on  a  singl^  antenna  scan  of  0.5  or  0.9  as  appropriate.  The  con¬ 
ditions  of  applicability  are  those  associated  with  the  use  of  the  term 
"detectability"  which  implies  that  a  limited  amount  of  eye  scanning  is  in¬ 
quired,  as  contrasted  with  the  term  "visibility,"  in  which  foreknowledge 
of  the  location  of  the  pulse  is  available  to  the  observer.  However,  these 
models  predict  performance  which  will  be  better,  in  general,  than  in  real 
situations  in  which  operators’  efficiency  is  reduced  by  boredom,  fatigue, 
and  distractions.  No  attempt  is  made  here  to  model  these  effects  or  those 
of  backgrounds  including  interference,  or  confusing  targets.  References 
3  and  4  contain  information  on  these  topics,  but  the  source  information 
is  not  considered  reliable  enough  to  include  in  a  model  at  this  time. 

Included  in  this  report  are  continuous- function  models  applicable 
to  A,  PPI,  and  B  displays,  discussions  of  probability  of  detection  as 
a  function  of  signal-to-noise  ratio  and  of  target  exposure  time.  Also 
included  are  simple  computer  programs  for  the  equations  in  FOCAL*  language. 
A  simple  model  for  detection  in  a  clutter-spike  background  is  discussed 
based  on  experimental  data. 


*F0CAL  (FOrmula  CALculator)  is  a  Trade  Mark  of  the  Digital  Equipment 
Corporation. 
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II.  A-SCOPE  MODEL 


Outstanding  work  in  characterizing  the  performance  of  humans  observ¬ 
ing  A-scopes  was  performed  in  Group  44  of  the  Radiation  Laboratory  in 
World  War  II  and  reported  by  Haeff  [1]  and  Lawson  and  Uhlenbeck  [5].  The 
former  reference  offers  a  simple  mathematical  expression  for  the  perform¬ 
ance,  whereas  the  latter  reference  collects  a  more  complete  group  of 
studies  of  dependences  of  performance  on  radar  variables. 

The  model  proposed  here  is  shown  in  Tables  I  through  IV.  An  addi¬ 
tional  assumption  for  the  A-scope  not  mentioned  in  the  introduction  is: 

(5)  Adequate  display  brightness  and  contrast  in  room  light  is  offered. 

The  model  is  believed  to  be  applicable  over  the  following  range  of  variables: 

P.R.F.  12  <  f  <  3000  Hz 

r 

Pulse-length  x  bandwidth  0.15  <  Bt  <  20 

Display  duration  0.01  <  Tp  <  60  sec 

No.  of  cells  displayed  2  <  <  60 

Angle  subtended  by  pulse  2  x  10  ^  <  a  <0.03  radians 

The  agreement  with  the  experimental  data  of  Haeff  [1]  and  Lawson  and  Uhlen¬ 
beck  [5J  is  illustrated  by  Table  V  and  appears  to  be  typically  within  about 
+  1.5  d3.  Calibration  of  the  constant  C  was  made  using  the  data  of  Figures 

A 

8.18,  8.23  and  8.27  of  Reference  3. 

Two  dependences  which  have  been  studied  were  not  included  in  the  model, 
because  under  normal  conditions  they  result  in  negligible  effect  on  visibility. 
First,  the  product  of  video  bandwidth  times  pulse  length  was  found  to  have 
no  measurable  effect  on  visibility  over  a  range  of  0.1  to  10  [3].  Second, 
the  amount  of  deflection  of  the  spot  produced  by  average  noise  was  found  to  de- 
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grade  the  visibility  if  it  was  less  than  about  0.5  mm  (=1.5  mr)  but  no 
improvement  was  seen  for  deflections  above  that  value.  It  should  be 
possible  ir.  all  practical  situations  to  provide  a  deflection  of  a  few 
milliradians  at  the  eye . 

It  was  stated  by  Lawson  that  display  brightness  was  not  an  important 
variable  in  determining  A-scope  visibility,  provided  the  observer  "can 
see  the  trace  clearly."  This  result  is  potentially  in  contradiction 
with  the  Blackwell  contrast  model  [6]  which  implies  that  brightness  should 
be  an  important  factor  at  levels  less  than  about  10  f oot-Lamberts .  Trace 
brightness  appears  to  enter  the  A-scope  model  by  determining  the  critical 
repetition  rate,  f^.  A  brighter  trace  should  improve  the  contrast  sensi¬ 
tivity  of  the  eye  and  raise  fc,  the  repetition  frequency  at  which  the  noise 
background  is  no  longer  granular  to  the  eye .  The  value  of  f  chosen  here 
is  that  found  empirically  by  Lawson.  No  evidence  is  shown  that  the  depend¬ 
ence  of  f  on  brightness  was  studied. 
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Table  I 

Input  Variables  for  A-Scope  Model 


Symbol 

Units 

FOCAL 

Symbol 

Definition 

B 

MHz 

BW 

Bandwidth  of  Receiver  (IF) 

T 

psec 

TP 

Transmitted  Pulse  Length 

«d 

nmi 

RD 

Displayed  Range  Interval 

D 

o 

in 

OD 

Distance  of  Eye  from  Scope 

S 

RPM 

SC 

Antenna  Scan  Rate 

3 

a 

Deg 

BM 

Azimuth  Antenna  Beamwidth  (3-dB  one-way) 

f 

r 

Hz 

RP 

Pulse  Repetition  Frequency 

D 

in 

LD 

Display  Trace  Length 

| 


i 

< 

i 

i 

5 


5 


Table  II 


Intermediate 

Variables  of  the  A-Scope  Equations 

Symbol 

FOCAL 

Symbol 

Definition 

GBandA 

GB 

Receiver  bandpass  filter  factor 

s 

SM 

Display  sweep  rate  (in/ms) 

a 

AL 

Angle  subtended  at  eye  by  pulse  on  display  (rad) 

a 

c 

— 

A  critical  angle 

Gc 

Sweep 

GS 

Factor  related  to  apparent  size  of  pulse 

f 

c 

— 

A  critical  prf  at  which  the  noise  is  uniform  in 
density  to  the  eye 

GRepA 

GR 

Integration  factor 

td 

TD 

Time  pulses  are  near  maximum  height  as  beam  scans 
past  target 

GTime 

GT 

Factor  for  finite  display  time 

N 

s 

NS 

Number  of  radar  cells  displayed 

GCells 

GC 

Factor  of  improvement  for  few  cells  monitored 

CA 

CA 

Calibration  factor 

P  .  /P 
mm  n 

(LP  5n  dB) 

Minimum  detectable  target  signal-to-average-noise 
ratio  referred  to  receiver  input  (noise  in  band¬ 
width  B) 
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Table  IV.  A-Scope  Model  Program 


C -FOCAL  S  2/71 

ni.G2  C  A-SCOPE  MODEL!  TO  INPUT  VARIBLES  6  1.30 
Ol.iO  S  CA* .0 1 7 
01.20  6  2. 10 

01.30  A  ?BV  TP  RP  8M  SC  RD  LD  OD  ? 

02.10  S  G8»< 1+ I /8V/TP) ♦ 2 

03.10  S  5M*LD/ 1 2. 35/RD 
03.20  S  AL*SM*TP/OD 

03.30  S  6S-.63*FEXP<rL06<4E-3*C l+AL/4E-3)t2)/AL>/3) 

04.10  S  GR«FSQT<2E3*C  1«-RP/2E3)/RP> 

05.10  S  TD-BM/12/SC 

05.20  S  GT«FEXP<2*FL0GtTD/8>/3> 

05.30  S  GT»< 1 +GT) /GT 

06.10  S  toS»LD/SM/TP 
06.20  S  GC»NS/(2*NS) 

07.10  S  LP"4.34*FL0G<CA*GB*GS#GR*GT*GC> 

08.20  T  1  *4.02,  ?LP  ? 

* 
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Table  V.  Comparison  of  A-scope  Data  with 
Model  Calculations 


D  =  304.8  mm 
o 

D  =  76.2  mm 


BT 

f r (Hz) 

TD(sec) 

ST 

P  ,  /P 
min  n 

Calculated 

(dB)1 

„  2 
Data 

Diff  (dB) 

1.2 

200 

0.043 

0.05 

+10.7 

+10.2 

+0.5 

0.25 

+  8.4 

+  7.7 

+0.7 

1.5 

+  6.9 

+  7.2 

-0.3 

1.2 

200 

3 

0.005 

+  3.4 

+  3.7 

-0.3 

0.05 

+  0.1 

-  0.3 

+0.4 

0.7 

-  3.4 

-  3.8 

+0.4 

2 

-  3.6 

-  3.8 

+0.2 

9 

-  2.6 

-  2.3 

-0.3 

13 

12 

3 

1.7 

-  2.4 

-  2.1 

-0.3 

200 

-  8.3 

-  7.6 

-0.7 

3000 

+12.4 

-13.1 

+0.7 

0.18 

12 

3 

1.7 

+13.3 

+13.4 

-0.1 

200 

-  7.4 

+  7.9 

-0.5 

3000 

+  3.3 

+  3.4 

-0.1 

1.1 

32 

3 

1.7 

+  2.6 

+  2.1 

+0.5 

200 

-  3.3 

-  3.4 

+0.1 

3000 

-  7.4 

-  7.4 

0 

(1-2) 3 

200 

0.04 

0.05 

+10.9 

4 

+10.3 

+0.6 

0.5 

4.1 

5.2 

-1.1 

4 

-  0.5 

1.2 

-1.7 

60 

-  3.6 

-  1.8 

-1.8 

(1.2) 3 

3200 

0.012 

1.6 

+  6.4 

+  6.24 

+0.2 

0.12 

-  0.1 

-  3.1 

+3.0 

1.5 

-  6.4 

-  7.8 

+1.4 

35 

-10.3 

-11.1 

+0.8 

Av.  0.1  +  0.9  dB  rms 

Note:  1.  Criterion  of  P^=  0.9. 

2.  Data  from  Reference  5.  Figures  8-18,  8-23,  and  8-27  have  been 
adjusted  by  subtracting  10  log  (Bt). 

3.  Assumed  value. 

4.  Average  of  P-1  and  P-7  data  from  Reference  5,  Figures  8-27. 
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III.  PPI  MODEL 


The  work  of  Payne-Scott  i2]  of  the  Australian  CSIR  on  the  performance 
of  humans  viewing  PPI  displays  is  outstanding  for  its  comprehensiveness  and 
physical  insight,  and  it  is  the  principal  basis  for  the  model  presented  here. 
The  Payne-Scott  work  is  so  complete  that  no  work  on  PPI  displays  since  pub¬ 
lished  can  be  compared  fcith  it  without  assuming  values  for  missing  important 
variables. 

The  model  is  presented  in  Tables  VI  through  IX.  It  is  applicable  over 
the  following  range  of  variables: 

TS 

Ratio  of  pulse  length  to  spot  size  0.1  <  —  <  19 


Pulse  length  and  bandwidth 
Screen  brightness 
Antenna  scan  rate 
Azimuth  beamwidth 
P.R.F. 


0.1  <  Bx  <  20 

0.001  <  I  <  100  ft  Lamberts 

1  <  S  <  100  rpm 

1  <  6^  <  12  deg 

40  <  f  <  4000  Hz 
r 


It  is  not  implied  that  the  model  is  not  valid  outside  these  limits,  but  only 
that  it  has  not  been  adequately  compared  with  data  outside  them.  The  model 
is  derived  from  that  of  Payne-Scott  by  making  two  changes.  The  "hard"  corners 
of  the  model  have  been  replaced  by  "soft"  ones  allowing  the  use  of  contin¬ 
uous  functions  for  representation,  and  a  liminal-contrast  model  based  on 
the  newer  data  of  Blackwell  [6]  has  been  used.  The  use  of  the  Blackv’ell 

model  results  in  underestimation  of  P  .  /P  and  necessitates  the  inti o- 

mxn  n 

duction  of  the  calibration  constant,  Cp. 

The  model  equations  and  parameters  were  validated  using  Payne-Scott's 
data  of  Figures  7.2,  7.3,  7.4,  and  7.5  of  Reference  2.  The  values  of  vari- 
bles  used  by  Payne-Scott  but  not  studied  were: 
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D  =  2.25  in 


R  =  0.45  R]) 

D  =  15  in 
o 


a  = 

b  = 
I  = 
d  = 


0.15  sec 

1.2 


-la 


for  P7  phosphor 


0.126  ft-Lambert  =  0.04  ft-candle 
0.024  in 


The  value  of  the  calibration  constant  Cp  was  adjusted  to  give  minimum  difference 
between  the  Payne-Scott  data  and  the  model  prediction.  The  result,  shown  in 
Table  X,  is  a  maximum  difference  of  3.4  dB  between  the  two  (which  is  slightly 
greater  than  the  internal  variation  of  the  Payne-Scott  data)  and  quantitative 
agreement  between  the  two  with  respect  to  location  of  break  points  and  to 
slopes  of  asymptotes. 

The  liminal-contrast  model  for  the  eye  (GContr)  was  designed  to  fit  the 
family  of  curves  of  Figure  16  of  Reference  6,  which  applies  to  long  exposure 
of  the  target  to  take  advantage  of  eye  scanning.  The  data  of  Blackwell's 
Figure  11,  which  apply  to  a  6-second  exposure  of  the  target,  have  the  same 
shape  as  for  long  exposure  but  correspond  to  a  constant  of  2.3  (instead  of 
1.27)  in  the  formula  for  G^ontr  in  Table  V.  The  necessity  to  introduce  Cp 
is  hypothesized  to  be  required  because  (a)  the  Payne-Scott  experiment  allowed 
more  possible  positions  for  the  target  than  Blackwell's,  and  (b)  Payne  Scott's 
target  was  soft-edged  and  generally  not  symmetical,  whereas  Blackwell's  was 
round  with  an  abrupt-contrast  perimeter.  The  data  of  Schade  [7]  suggest  that 
the  liminal-contrast  sensitivity  of  the  eye  is  strongly  adversely  affected  by 
the  "softness"  of  target  contour,  especially  of  larger  targets. 

The  PPI  model  can  be  used  for  describing  the  performance  of  a  B-display 

by  making  two  changes.  In  Sections  3  and  5  of  Table  VIII,  R  is  replaced  by 

R_,  and  the  formulae  for  N  ,  G  ,  and  h  are  changed  by  setting  D  =  W/2tt 
1/  S  CiXC  s 

where  W  is  the  azimuth  width  of  the  display.  The  formula  for  s  is  not  changed, 
but  in  it,  D  is  the  range  dimension  of  the  display. 


Table  VI 


Input  Variables  for  PPI  Model 
FOCAL 


Symbol 

Units 

Symbol 

Definition 

B 

MHz 

BW 

Bandwidth  of  Receiver  (IF) 

T 

ys 

TP 

Pulse  Length 

0 

a 

deg 

BM 

Azimuth  Antenna  Beamwidth 

L 

in 

LD 

Length  of  Display  Trace 

d 

in 

SP 

Diameter  of  Beam  Spot 

D 

o 

in 

OD 

Distance  of  Observer's  Eye  from  Screen 

R 

nmi 

RA 

Range  to  Target 

% 

nmi 

RD 

Display  Range 

f 

r 

Hz 

RP 

Pulse  Repetition  Rate 

S 

rpm 

SC 

Antenna  Scan  Rate 

k! 

K1 

C-R-T  Grid-Transfer-Law  Exponent 

=  1  for  square-law  detector 

k2  K2 

=  2  for  linear  detector 

a  s  ^  DE  Decay  Rate  of  C-R-T  Phosphor 

b  QB  Exponent  of  Decay  Factor 

I  ft-Lambert  IN  Brightness  of  Noise  Background  on  C-R-T  Screen 

P  .  /P  dB  LP  Minimum  Detectable  Target-Signal-to-Average- 

min  Noise  Ratio  Referred  to  Receiver  Input 
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Table  VII 

Intermediate  Variables  of  PPI  Model 


Symbol 

FOCAL 

Symbol 

Definition 

GBandP 

GB 

Response  factor  of  Receiver /Filter 

Q 

Trans 

CT 

Non-linear  response  factor  of  envelope  detector  and 
C-R-T  grid 

GExc 

GE 

Excitation  factor  of  a  beam  spot  produced  by  signal 
pulses 

G 

Contr 

GC 

Contrast  sensitivity  of  the  eye 

GRepP 

GP 

Integration  factor  for  noise  pulses 

lmin/Pn 

LP(in  dB) 

Minimum-detectable  target-si gnal-to-average-noise  ratio 
referred  to  receiver  input 

s 

SM 

Sweep  rate  of  beam  (in/ps) 

h 

s 

SA 

Cell-size/spot-size  factor 

♦s 

SE(01) 

Solid  angle  of  beam  spot  at  eye  (ster) 

* 

SE(OO) 

Solid  angle  of  radar  cell  at  eye  (ster) 

♦c 

— 

A  critical  solid  angle  of  eye  contrast  sensitivity 

q 

QE 

A  "softness"  exponent 

n 

s 

NS 

Number  of  noise  pulses  integrated  in  one  beam  spot  in 
one  scan 

n 

NN 

Total  number  of  noise  pulses  integrated  per  spot 

CP 

CP 

A  calibration  constant 

Table  VIII 


PPI  Model  Equations 


.  12.36 


!  fTsl  2  f  f0aR  D  *  1 

j1  +N  )  J1  +  (rvKo) 


s  •  6  R  D  Ti 

Ts  a _ 

Id  d  18°  J 


,  TT  d 
h3  •  4  72 
o 


5  x  10 


-6  1  +  r 


(0.08  In  <p  Y 


Table  VIII  (continued) 


Pmin/Pn  Cp  '  GBandP  *  GTrans  '  GExc  *  GRepP  *  GContr 
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Table  IX.  Program  for  PP1  Display  Model 


C-FOCAL  S  2/71 

01 .01  C  PPI  MODEL.  TO  INPUT  VARIABLES*  G  1.22. 

01.10  S  PI-3.14159 
01.20  S  CP-5.2 
01.21  G  1.30 

01.22  A  ?  BV  TP  TA  LD  SP  OD  RD  RA  RP  SC  Ki  K2  DE  OB  IN  ? 
01.23  G  1.1 

01*30  F  RA«RD/!0*RD/10#RD)D  21 D  1.40 
01.35  QUIT 

01*40  T  f  X5.02#  ?RD#  RA#  LP  ? 

02.10  S  GB* l/< 1-F£XP< -2-BV—TP) ) ♦ 2 

02.20  S  6T-K2/KI 

02.31  S  SM-LD/RD/ 12.35 

02.32  S  Tl-TP-SM/SP 

02.33  S  T2»LD*TA-PI*RA/180/SP/RD 

02.34  S  SA— FSOT<< I+Tl*Tl)-< 1+T2*T2>> 

02.35  S  GE-SA/T1/T2 

02.37  S  SE<0G)«SA*PI*<<SP/0D>»2>/4 

02*39  S  J-OJD  3 

02.41  S  KR-FSQT< 1*C2*BV*SP/SM)»2) 

02.43  S  SE<01)«SP*2*PI*FS0T< !♦« SM/2/BV/SP) »2> /4/0D»2 
02.55  S  NS-KR-7 • 5-RP-SP-RD/5C/LD/RA 
02.57  S  T3-FEXP<FL0G< 1*60*DE/SC)*C-QB>> 

02.59  S  NN«NS*< l*T3>/< 1-T3) 

02.61  S  J-ll  D  3.41 D  3.5 

02.6-  S  GR»FSQT< 1+ 1 /NN/GC( 0 l > »2/GT» 2) 

02.70  D  4 

03.10  S  T4-FEXP(.55-FL0G(IN>) 

03.20  S  ST*-5E-6-<  1*T4)/T4 
03.30  S  QE*( .08— FLOGf  ST) ) »2 

03.40  S  GC<J»-FEXP(FLOGC l+FEXP(OE*FLOG< SE(J)/ST> ) )/OEJ 
03.50  S  GC<«J)-GC<J>*1  .27*ST*FS0T(ST)/SE(J) 

04.10  S  LP  -10  -FL0G<GB*GT*GE*GC<00>»GR*CP)/FL0G< 10) 
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Table  X.  Comparison  of  PPI  Data  with 
Model  Calculations 


T  =  1  (is 
R  =  0.45  IL 
Do=  15  in 
d  =  0.024 
I  =  0.12  ft  L 


V  3 

V  2 

a  =  0.15 
b  =  1.2 
L  =  2  in 


TS 

P./p 

(dB)1 

~d 

f r (Hz) 

Bt 

S(rpm) 

0  (Deg) 

a 

min  n 
Calculated 

2 

Data 

Diff (dl 

0.1 

1600 

1.5 

4 

4 

+  0.6 

-  0 

+0.6 

1.0 

-  7.5 

-  8 

+0.5 

10 

-  8.1 

-  9.5 

+1.4 

0.1 

100 

1.7 

4 

4 

+  2.3 

+  2 

+0.3 

1 

-  3.2 

-  3 

-0.2 

1C 

-  2.7 

-  4 

+1.3 

0.1 

200 

1 

4 

4 

+  3 

-  3.5 

-0.5 

1 

-  2.5 

-  1.5 

-1 

10 

-  1.7 

-  3 

+1.3 

7.2 

40 

1.5 

4 

4 

-  0.7 

-  2 

+1.3 

400 

-  5.6 

-  7 

+1.4 

4000 

-10.3 

-12 

+1.7 

0.45 

40 

2 

4 

4 

-  0.3 

+  1.5 

-1.8 

400 

-  4.4 

-  3 

-1.4 

4000 

-  5.0 

-  5.5 

-0.5 

0.1 

40 

1.5 

4 

4 

+  4.0 

+  5 

-1.0 

400 

+  1.2 

+  1 

+0.2 

4000 

+  0.5 

+  1 

-0.5 

0.93 

1600 

13 

4 

2 

-  6.8 

-  6.5 

-0.3 

4 

-  9.1 

-  8.5 

-0.6 

8 

-11.1 

-10.5 

-0.6 

7.2 

100 

1.5 

4 

2 

-  1.0 

+  0.5 

-1.5 

4 

-  2.6 

-  1.5 

-1.1 

8 

-  3.8 

-  3 

-0.8 

7.2 

100 

1.5 

64 

2 

+  0.7 

+  3 

-2.3 

4 

-  1.0 

+  0.5 

-1.5 

8 

-  2.1 

-  1 

-1.1 
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Table  X. 


Comparison  of  PPI  Data  with 


1W  U  l. 


/VI  -«.J - 

uaimia  u  xuiis 


/a _ j  _  .  -  j  \ 


\OUULXUUCU ) 


TS 

_d_ 

fr(Hz) 

Bt 

S(rpm) 

6  (Deg) 

P  .  /P 
mm  n 

Calculated 

(dB)1 

2 

Data 

Diff (dB) 

7.2 

400 

1.5 

1 

4 

-  7.9 

-  7 

-0.9 

4 

-  5.6 

-  6 

+0.4 

10 

-  4.7 

-  6 

+1.3 

50 

-  4.0 

-  5 

+1.0 

0.1 

1600 

1.5 

1 

4 

+  0.4 

-  3 

+3.4 

4 

+  0.6 

-  1 

+1.6 

10 

+  0.7 

-  1 

+1.7 

50 

+  0.8 

0 

+0.8 

Average  0.1  +  1.3  dB 

Notes:  1.  Criterion  ?D=  0.5. 

2.  Data  from  Reference  2 
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IV.  PROBABILITY -OF-DETECTION  FUNCTIONS 


The  display  models  presented  in  the  two  preceding  chapters  are  de¬ 
signed  to  predict  the  target-signal-to-noise  ratio  which  would  result  in 
a  0.5  probability  of  detection.  However,  other  probability  levels  are  of 
interest,  and  the  function  P^(X),  where  X  =  10  log  (P  /P  ) ,  is  the  repre¬ 
sentation  sought.  Such  functions  have  been  calculated  in  abundance  for 
the  case  of  the  automatic  detector,  consisting  of  an  ideal  envelope 
integrator  followed  by  a  threshold  [8,  9,  10].  The  functions  have  been 
measured  for  a  human  observing  an  intensity-modulated  display  by  Tucker  [11]. 
It  is  of  interest  to  compare  the  two  cases.  Because  of  the  scatter  in  the 
experimental  data,  the  only  information  about  the  shape  of  the  function 
that  it  is  reasonable  to  extract  is  the  slope  near  P^  =  0.5.  For  example, 
Tucker's  data  for  N  =  28  pulses  displayed  imply  a  slope  for  dP/dX  of  about 
0.2  dB  1  whereas  the  calculations  of  DiFranco  and  Rubin  show  a  correspond- 

_i  3* 

ing  slope  of  0.23  dB  *  for  N  =  30  and  a  false  alarm  number,  n  ,  of  10  ;  which 

is  close  to  that  recommended  by  Skolnik  [12]  as  best  fitting  the  data  of 
Tucker.  Thus  the  two  cases  are  in  good  agreement  with  respect  to  the  width 
of  the  curves.  In  addition  the  curves  for  the  operator  tend  to  increase  in 
width  (decrease  in  slope)  as  N  increases.  This  trend  is  followed  for  the 
automatic  detector  only  if  the  number  of  pulses  between  false  alarms  is  held 
constant.  If  the  probability  of  false  alarm  per  unit  time  is  held  constant, 
the  trend  is  for  the  slope  to  increase  with  increasing  N.  Thus  one  concludes 
that  the  human  can  operate  with  a  lower  effective  threshold  setting  than  the 
automatic  detector  with  constant  false-alarra  probability. 

It  is  concluded  that  the  automatic-detector  probability-of-detection 

functions  are  an  adequate  representation  of  human  performance  for  a  false- 
-4 . 35 

alarm  rate  of  10  per  pulse  [12],  provided  the  signal-to-noise  ratio 

corresponding  to  =  0.5  is  adjusted  to  be  that  predicted  by  the  appro¬ 
priate  model. 

For  a  nonfluctuating  signal,  the  probability  of  detection  is  related  to 
signal-to-noise  ratio  approximately  as  follows: 


*n'  is  the  reciprocal  of  the  false-alarm  probability. 
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P  ~  exp  (0.45  X  In  10) 

D  1  +  exp  (0.45  X  in  10)  * 


(1) 


This  approximation  is  derived  from  the  curves  of  Reference  10  for  30  inte- 

3 

grated  pulses  and  a  false-alarm  number  of  10  . 

The  shape  of  the  probability-of-detect ion  function  is  not  a  strong 
function  of  either  number  of  pulses  integrated  or  false-aiarm  number,  pro¬ 
vided  one  does  not  require  accuracy  of  the  representation  in  (1)  for  either 
very  small  or  very  large  values  of  P^. 

The  relationship  in  (1),  which  is  for  a  nonfluctuating  target  in  a 
background  of  noise,  can  be  considered  to  be  a  conditional  probability, 
and  the  rules  relating  conditional  and  joint  probabilities  can  be  used 
to  derive  an  expression  for  for  fluctuating  targets,  provided  their 
signal-strength  distributions  are  known.  Call  the  probability  of  de¬ 
tection  for  a  fluctuating  target  P^,  and  let  the  density  function  of  signal 
strength  be  given  as  p(X)  in  terms  of  the  normalized  variable  X.  Then 


vv 


PD(X)  p(x|xi)dX 


(2) 


-'x 

where  X^  represents  parameters  of  the  distribution.  For  example,  let 
a  target  be  log-normally  distributed  with  median  Xq  and  standard  deviation 
ox>  so  that 


Pv(X)dX  =  - - 

V  JlH 


(X  -  XT 

exp  j - ~ -  't  dX  » 

2o„ 


(3) 


where  X  and  are  in  dB. 
o  X 


Then, 


VV  V  = 


(x  -  xor 

exp  [ - 2 —  3 

2  G„ 


/2tF  cv  (1  +  exp [-0.45  X  In  10]) 

A 


dX 


(4) 


—CO 


This  expression  has  been  evaluated  numerically  for  a,,  -  0,  3,  and  6  dB 

A 

and  the  results  are  plotted  in  Figure  1.  It  is  seen  that  the  width  of 


the  Py  function  increases  as  0^,  increases. 
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Figure  1.  Approximate  probability  of  detection  of  a  log- 
tributed  target  signal. 


V.  TARGET-SIGNAL  EXPOSURE  TIME 


Both  the  display  models  presented  here  predict  the  detectability  of  a 

target  signal  in  receiver  noise  with  limited  eye  scanning  required.  That 

is,  by  detectability  is  meant  the  signal  which  can  just  be  detected  provided 

that  the  operator  is  operating  at  maximum  efficiency  and  has  adequate  time 

to  search  the  area  displayed  and  utilize  the  foveal  sensitivity  of  the  eye. 

Thus  detectability  represents  an  intermediate  ideal  that  is  achievable  under 

many  circumstances,  but  in  many  other  situations  an  operator's  performance 

may  be  degraded.  If  exposure  time  of  the  target  signal  is  too  short  for 

effective  eye  scanning,  then  the  minimum  detectable  signal  may  be  limited  by 

the  off-axis  sensitivity  of  the  eye.  This  sensitivity  function  is  related 

to  the  foveal  sensitivity,  (6I/I)  .  by  [13] 

mm 

(“)  =  (rj)  •  exp  {+0.202  0}  ,  (5) 

off  axis  min 

where  8  is  the  angle  In  degrees  of  a  line  to  the  target  spot  from  the  foveal 
axis.  Note  that  this  function  implies  that  an  increase  in  contrast  of  10  dB 
is  required  at  an  angL_  of  11.4  degrees  off  the  foveal  axis,  which  is  the 
half-angle  subtended  by  a  5- inch  display  at  12  inches  from  the  eye.  The 
use  of  Equation  2  is  properly  that  of  an  upper  bound  to  eye  sensitivity  de¬ 
gradation,  unless  a  detailed  eye  scanning  model  can  be  postulated. 

The  detectability  models  are  to  be  interpreted  as  applying  to  a  single 
integration  period  defined  by  a  single  scan  o'"  a  few  scans  integrated  by  the 
phosphor.  If  a  target  signal  is  exposed  for  a  long  time  spanning  many  phosphor 
integration  periods,  the  performance  of  an  operator  should  improve.  However, 
the  appropriate  quantitative  means  of  predicting  the  improvement  for  the  case 
of  radar  displays  is  not  clear.  Swets  [14],  in  a  generalized  detection 
experiment  (aural),  offers  data  to  distinguish  between  two  prominent  models 

of  improvement.  In  one  mode  the  operator  is  presumed  to  integrate  the  signals 

1/2  2/3 

from  M  events  so  that  improvement  occurs  at  the  rate  of  M  to  M  .In  the 
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other  mode  the  display  storage  intervals  are  presumed  to  be  independent 
events  for  the  operator  so  that  this  law  holds  for  cumulative  probability 
of  detection: 

PC  ■ 1  -  j1  -  VM'  (6) 

where  P  is  the  single-event  probability  of  detection.  Swets*  data  imply 
that  for  long  exposure  times  the  operator  behaves  typically  as  if  the  in¬ 
dividual  events  are  independent  of  each  other  and  no  integration  is  performed 
by  him.  This  has  not  been  verified  for  radar  operators,  but  it  is  tentatively 
appropriate  to  use  Equation  6  for  predicting  cumulative  probability  of  de¬ 
tection  by  humans  for  repeated  detection  opportunities  spaced  by  more  than 
about  10  sec. 

Equation  6  can  be  more  easiJy  evaluated  in  the  form 

Pc  =  1  -  exp  {M  In  (1  -  ?D)}  .  (7) 

If  Pp  in  Equation  7  is  set  equal  to  Py  of  Fquation  4,  cumulative  distri¬ 
butions  of  detection  probability  result  for  various  log-normally  dis¬ 
tributed  targets.  Curves  are  plotted  in  Figure  2  for  =  0,  3,  and  6  dB 
and  values  of  30  and  200  for  M,  the  number  of  independent  radar  scans. 

It  is  seen  that  the  increased  width  of  P  is  retained  in  P  ,  the  cumula- 

U  v> 

tive  probability,  and  that  a  given  overall  probability  of  detection  is 
achieved  with  lower  median  signal  levels  for  wider  distributed  signals. 
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VI.  DETECTION  IN  SEA  CLUTTER 

Radar  sea  return  forms  a  background,  against  which  target  signals 
are  detected,  that  has  strikingly  different  properties  from  receiver  noise. 
The  amplitude  distribution  of  sea  return  is  wider  in  dynamic  range  than 
receiver  noisej and  clutter  signals  are  correlated  in  space  and  time  over 
longer  intervals,  which  are  related  to  the  physical  wave  processes  rather 
than  circuit  bandwidth.  Both  the  distribution  and  correlation  properties 
adversely  affect  the  efficiency  of  human  radar-display  observers,  in 
addition  to  the  simple  factor  of  raising  the  average  background  against 
which  target  signals  are  presented  above  that  of  noise.  Although  the 
statistical  properties  of  sea  return  are  known  approximately  [15,  16,  17] } 
the  effects  on  operator  performance  have  been  described  only  in  qualita¬ 
tive  ways.  In  this  chapter,  one  mode  of  behavior  of  an  operator  perform¬ 
ing  detections  against  a  sea-clutter  background  is  described  along  with 
a  physical  model  justifying  his  behavior. 

Qualitative  descriptions  of  sea  clutter  since  World  War  II  have  re¬ 
ferred  to  its  "spiky”  nature,  which  reflects  the  high-energy  tail  of  its 
distribution  as  well  as  its  temporal  and  spatial  correlation  properties. 
When  clutter  is  not  considered  to  be  spiky,  it  is  said  to  be  "well  de¬ 
veloped."  Some  conditions  under  which  the  two  extreme  states  tend  to 
be  seen  are: 

Spiky  Clutter:  with  horizontal  polarization,  with 

low  wind  speeds  with  swell,  at  low 
grazing  angles. 

Well-Developed  Clutter:  with  vertical  polarization,  with 

high  wind  speeds,  with  very  long 
pulse  lengths  or  wide  beamwidths, 
at  high  grazing  angles. 

The  spike  returns  are  presumed  to  result  from  some  combination  of  non- 
uniform  distribution  and  features  cf  tbe  gross  surface  contour  [e.g., 
see  Reference  17] 
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When  sea  return  is  well  developed,  the  clutter  is  spatially  more 
homogeneous  than  when  spiky  and  it  tends  to  fluctuate  more  rapidly. 
Depending  on  antenna  scan  rates,  wavelength,  cell  size,  and  sea  condi¬ 
tions,  ratios  of  minimum-detectable  target  signal  to  average  background 
level  can  be  as  small  for  homogeneous  clutter  as  about  2  dB  above  the 
corresponding  ratio  for  noise.  However,  in  the  spiky  cases,  minimum 
detectable  ratios  can  be  much  higher  than  for  a  noise  background.  There¬ 
fore  of  the  two  conditions,  the  spiky  one  produces  the  most  serious 
system  degradation,  is  the  least  well  bounded,  and  is  the  most  trouble¬ 
some  in  attempts  to  predict  system  performance  with  realism.  In  addition, 
most  of  the  radar  volume  of  interest  in  sea-search  situations  is  contami¬ 
nated  by  spiky  rather  than  well-developed  clutter. 

A  search  for  useful  ways  to  characterize  clutter  spikes  has  been 
frustrating.  This  is  because  the  spike  is  a  transient  phenomenon  whose 
location  in  time,  range,  and  azimuth  is  random,  so  that  direct  observa¬ 
tion  of  a  spike  is  difficult  with  the  usual  techniques  of  radar  instru¬ 
mentation.  An  important  clue  to  one  property  of  spikes  came  from  a  re¬ 
latively  crude  but  effective  technique  of  observation.  Systematic  des¬ 
cription  of  the  dependences  of  clutter  levels  on  various  radar  and  en¬ 
vironmental  parameters  has  been  carried  on  by  many  observers.  In  the 
absence  of  elaborate  instruments  it  has  been  found  that  a  useful  measur¬ 
able  of  clutter  levels  is  the  "average  of  peaks"  observed  by  eye  on  an 
A-scope  display.  Its  use  dates  from  the  period  when  the  A-scope  was  the 
only  quantitative  instrument  for  wideband  video  observations  and  when 
envelope  detectors  of  only  limited  dynamic  range  (linear  or  square  law) 
were  available.  The  average,  median,  or  mode  of  a  signal  is  difficult  to 
estimate  with  such  a  detector,  but  the  peaks  are  obvious.  An  interesting 
property  of  this  "average-of-peaks"  measurable  is  that  it  is  fairly  re¬ 
producible  between  successive  measurements  by  a  given  observer  and  be¬ 
tween  different  observers,  and  this  property  of  reproducibility  has  led 
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to  extensive  use  by  some  observers  in  recent  times*.  It  was  postulated 
that  for  this  reliability  to  exist  the  clutter  must  have  a  well-defined 
high-energy  boundary,  which  would  imply  a  well-defined  cross  section 
for  clutter  spikes. 

The  above  hypothesis  was  checked  with  an  experiment  in  which  photo¬ 
graphs  were  taken  of  the  PPI  display  of  a  high-power  S-band  radar  under 
conditions  of  low  wind  (V)  kts)  and  substantial  swell.  The  display  was 
adjusted  for  high  video  gain  and  bias  more  negative  than  cut  off  so  that 
clutter  appeared  as  white  spots  on  a  black  background.  Photographs  were 
taken  of  single,  antenna  scans  for  different  receiver  gain  settings  from 
maximum  (where  noise  could  be  seen)  to  minimum  (where  only  strong  target 
signals  were  visible)  in  about  5  dB  steps.  The  number  of  clutter  spikes 
(white  spots)  was  counted  in  an  area  45  aegrees  wide  by  40%  of  displayed 
range  centered  at  0.625  times  the  displayed  range,  and  that  number  was 
divided  by  the  number  of  radar  cells  in  the  area  (1700  to  5100  depending 

on  displayed  range)  to  form  an  estimate  of  false-alarm  probability,  P  . 

r 

The  logarithm  of  P  is  plotted  in  Figure  3  against  the  display  threshold 
r 

in  dBm  of  received  power  for  several  sequences  of  photographs .  The  result 
is  a  set  of  curves  with  plateaus  of  log  Pp  for  low-power  threshold  regions 
but  which  drop  abruptly  as  the  threshold  is  increased  through  a  certain 
value,  which  is  different  for  different  displayed  ranges.  The  interpre¬ 
tation  is  that  the  radar  cross  section  of  spikes  is  well  defined,  so  that 
the  number  is  constant,  independent  of  threshold  until  it  approaches  the 
spike  level.  It  appears  that  most  of  the  spikes  in  a  given  sample  have 

cross  sections  within  about  +  3  dB  of  the  median.  Using  the  constant  for 

2 

the  radar  of  -18  dBm  received  power  from  a  target  of  1  m  cross  section 
at  1  nmi,  the  median  spike  cross  sections  were  calculated  and  are  shown 
in  Table  XI. 


*e.g. ,  F.  B.  Dyer,  Georgia  Institute  of  Technology,  and  R.  Hess,  Airtronics, 
Inc. 


Probability  of  spike  signal  be 
received  power.  Arrows  indica 
spike  levels  at  average  ranges 


Table  XI.  Median  Clutter  Spike  Cross  Sections 


Displayed  Range 

Average  Range 

Cross  Section 

Number  Dens 

10  nmi 

6.25  nmi 

-19  dBsm 

2.2/nmi2 

20  nmi 

12.5  nmi 

-18  dBsm 

1.5/nmi2 

30  nmi 

18.75  nmi 

-22  dBsm 

0.8/nmi2 

It  is  difficult  to  decide  on  the  basis  of  these  data  alone  if  the  cross 
section  of  spikes  should  be  considered  as  range  independent,  because 
such  a  conclusion  would  relate  strongly  to  the  definition  of  the  propa¬ 
gation  conditions  that  exist.  Two  minor  comments  can  also  be  made  about 
the  data.  There  is  a  suggestion  of  two  steps  in  the  curve  in  Figure  3 
for  spikes  at  6.25  nmi  which  suggests  the  existence  of  two  spike  mech¬ 
anisms  at  that  angle  or  on  that  day.  Also^both  the  false-alarm  rate 
(in  radar  space)  and  the  number  density  (in  map  space)  are  monotonic 
decreasing  functions  of  range. 

The  internal  consistency  of  these  data  is  considered  to  be  good 
and  the  data  are  interpreted  to  be  in  support  of  the  hypothesis  that 
clutter  spikes  have  well-defined  cross  sections. 

The  question  of  how  a  human  operator  reacts  to  such  a  clutter  en¬ 
vironment  was  investigated  with  the  following  described  experiment. 

Radar  PPI  operators  were  assigned  the  task  of  designating  detected  targets 
in  the  45°  by  40%  of  displayed  range  area,  auJ  of  investigating  the  signal 
strength  of  all  detected  targets  by  stopping  the  scanning  antenna  and 
measuring  the  signal  on  an  A-scope.  The  experiment  was  performed  in  an 
area  of  ocean  frequented  by  many  transient  boats  of  all  sizes.  It  was 
found  that  out  of  about  25  targets  detected,  two  were  observed  tc  have 
occasional  peak  signals  about  10  dB  above  the  median  spike  levels,  none 
were  detected  with  less  than  10  dB  peak-signal  to  median-spike  ratio  and 
all  others  were  greater  in  peak  strength.  It  is  known  that  target  sig¬ 
nals  were  present  but  not  detected  in  this  experiment  with  peak  strengths 
less  than  10  dB  above  the  spikes. 
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It  is  interesting  to  compare  the  above  results  with  the  thresholds 

for  detection  of  target  signals  in  noise.  Assume  that  an  operator  will 

use  a  threshold  equivalent  to  one  producing  a  false-alarm  number  of 
4 

about  10  (see  Chapter  IV)  and  that  the  temporal  correlation  of  a  spike 
is  long  compared  to  the  dwell  time  of  the  antenna  beam  on  a  given  azi¬ 
muth,  so  that  only  one  independent  sample  is  obtained  per  scan.  For 
these  conditions  the  calculation  displayed  in  Reference  10  for  a  rcn- 
fluctuating  target  predicts  a  signal-to-average-noise  ratio  of  about 
10  dB  to  achieve  =  0.5  which  is  consistent  with  the  observed  result. 
Thus  it  is  concluded  that  a  useful  model  is  the  noise  model  with  the 
median  spike  level  substituted  for  the  average  noise  and  only  one  pulse 
effectively  integrated. 
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IX.  APPENDIX 


£ 

for  x»l,  f(x)  =  x  q; 

1 

at  x  =  I,  f(x)  '  2  q;  and  (x=l,  f(x)=l)  designates 

the  intersection  of  the  two  asymptotes. 

Three  choices  of  exponents  illustrate  their  control  of  the  hardness 
or  softness  of  the  corner.  Let  p=q.  Then,  for  p  =  0.5,  1,  and  2, 
f(l)  =4,  2,  and  /2y  respectively.  The  case  for  p  =  -q  =  2  is  the  form 
for  the  frequency  response  of  a  single  stage  R-C  low-pass  filter,  with 
x  identified  as  the  normalized  frequency  and  f (x)  as  tho  magnitude  of 
the  voltage  transfer  ratio. 

The  slope  of  the  left-hand  asymptote  is  adjustable  in  the  function, 

1 

f(x)  =  xr(l  +  xP)  q  ,  (10) 

which  is  described  by: 

for  x<<1,  f(x)  =  xr  ;  (11) 

to t  x»l,  f  (x)  i  xr  +  p/<1  ; 

1 

at  x  =  1,  f(x)  =  2  q;  and 

(x=l,  f(x)=l)  designates  the  intersection  of  asymptotes. 


34 


Thus,  if  a  function  is  desired  that  has  asymptotes  with  left  and  right 
slopes  of  +1  and  -1,  respectively,  and  a  sharp  corner,  appropriate 
choices  of  exponents  might  be: 


r  =  1, 
p  -  4, 
q  =  -2. 

A  soft-corner  function  with  the  same  slopes  would  result  from: 

r  =  1, 

P  =  1. 

1 

q  =  -  2  * 

B.  Brief  Summary  of  FOCAL  Commands  and  Symbols 

The  summary  of  commends  and  symbols  given  in  Table  XII  is  intended 
to  provide  sufficient  information  for  the  qualitative  understanding  of 
the  FOCAL  programs  listed  in  this  report.  The  reader  should  consult 
the  literature  of  the  Digital  Equipment  Corporation  if  detailed  use  of 
the  FOCAL  language  is  contemplated. 


XII.  Selected  FOCAL  Commands  and  Symbols 


Symbols  or 

Command  Abbreviation  Function 


SET  S 

COMMENT  C 

GOTO  G 

ASK  A 

TYPE  T 

DO  D 

QUIT  Q 


+ 


/ 

t 

AA 


Sets  the  value  of  the  variable  follow¬ 
ing  the  command  to  that  of  the  expres¬ 
sion  after  the  equals  symbol 

Program  ignores  following  statement 

Transfers  program  to  line  number  in¬ 
dicated 

Requests  a  value  of  variables  from  the 
teletype 

Outputs  the  value  of  variables  or 
statements  to  the  teletype 

Performs  the  instructions  of  line  or 
block  indicated  and  returns  program 
to  next  statement  following  DO 

End  of  program 

Separates  statements  on  the  same  line 

Causes  teletype  to  type  the  enclosed 
characters  as  the  statement  is  executed 

Add 

Subtract 

Multiply 

Divide 

Exponentiation  (integer  exponent  only) 

A  variable  name;  any  two  letters  qualify 
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XII.  Selected  FOCAL  Commands  and  Symbols  (Continued) 


Symbols  or 
Command 

FSQT(X) 

FLOG (X) 

FEXP(X) 

FSIN(X) 


Abbreviation 


Function 


Square  root  of  X 

Natural  logarithm  function  (loge  X) 

Generates  e  to  the  power  X 

Generates  the  sine  of  X  in  radians 

F  Performs  statements  following  semi¬ 

colon  on  same  line  for  values  of  the 
indicated  variable:  Start,  Step,  Last 


ij 


it 


i 

! 


FOR 


IfttQ  Kff  BKfl 


